Attorney's Docket No. : 1 4202-000400 1 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicant : Raymond Kurzweil Art Unit : 3661 

Serial No. : 10/734,616 Examiner : Christine M. Behncke 

Filed : December 12,2003 Conf. No. : 1709 

Title : VIRTUAL ENCOUNTERS 

Mail Stop Amendment 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 



REPLY TO NOTICE OF JULY 23, 2008 

Enclosed is a corrected Brief in response to the notice of non-compliance. While 
Appellant believes that the brief as filed was compliant in order to advance this case Appellant 
has repeated the citations for the analogous features of claim 13. No fee is due. Please apply 
any other charges or credits to deposit account 06-1050. 

Respectfully submitted, 



Date: August 2 1 , 2009 /Denis G. Maloney/ 

Denis G. Maloney 
Reg. No. 29,670 

Fish & Richardson P.C. 
225 Franklin Street 
Boston, MA 02110 
Telephone: (617) 542-5070 
Facsimile: (877) 769-7945 

22253140.doc 



CERTIFICATE OF MAILING BY EFS-WEB FILING 



I hereby certify that this paper was filed with the Patent and Trademark 
Office using the EFS-WEB system on this date: August 21, 2009 



Attorney's Docket No.: 14202-0004001 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicant 
Serial No. 
Filed 
Title 



Raymond Kurzweil 
10/734,616 
December 12, 2003 
VIRTUAL ENCOUNTERS 



Art Unit : 3661 

Examiner : Christine M. Behncke 

Conf.No. : 1709 



Mail Stop Appeal Brief - Patents 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 



APPEAL BRIEF ON BEHALF OF RAYMOND KURZWEIL 
The Appeal Brief fee of $270 has already been paid via the Electronic Filing System by 
way of deposit account authorization. Please apply any other charges or credits to Deposit 
Account No. 06-1050. 



CERTIFICATE OF MAILING BY EFS-WEB FILING 



! hereby certify that this paper was filed with the Patent and Trademark 
Office using the EFS-WEB system on this date: August 2 1 , 2009 



Applicant 
Serial No. 
Filed 
Page 



Raymond Kurzweil 
10/734,616 
December 12, 2003 
2 of 26 



Attorney's Docket No.: 14202-0004001 



(i.) Real Party In Interest 

The real party in interest in the above application is Kurzweil Technologies, Inc. 
(ii.) Related Appeals and Interferences 

The Appellant is not aware of any appeals or interferences related to the above-identified 
patent application. However, Appellant informs the Board that Appellant has a pending appeal 
in Serial No. 10/734,617, which is not yet docketed. 

(iii.) Status of Claims 

This is an appeal from the decision of the Primary Examiner in an Office Action dated 
May 15, 2009, finally rejecting claims 1-21, all of the claims in the application. The claims have 
been twice rejected. 

Claims 1-21 are the subject of this appeal. 

(iv.) Status of Amendments 

Appellant did not file a Reply to the Final Office Action. All previously filed 
amendments have been entered. A Notice of Appeal is being filed herewith. 

(v.) Summary of Claimed Subject Matter 



One aspect of Appellant's invention is set out in claim 1 as a virtual reality encounter 
system. "Referring to FIG. 1, a virtual encounter system 10 includes in a first location A, a 
mannequin 12a, a communication gateway 16a, a set of goggles 20a worn by a user 22a, and 
two wireless earphones (earphone 24a and earphone 26a) also worn by user 22a. System 10 can 
further include in a location B, a mannequin 12b, a communication gateway 16b, a set of 
goggles 20b worn by a user 22b, and two wireless earphones (earphone 24b and earphone 26b) 
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also worn by user 22b. Gateway 16a and gateway 16b are connected by a network 24 (e.g., the 
Internet).'" 1 

The inventive features of claim 1 include a humanoid robot having tactile sensors 
positioned along the exterior of the robot, the sensors sending tactile signals to a communications 
network. "Referring to FIGS. 7 A and 7B ... the mannequins are replaced by robots. For 
example, a robot 12b includes a series of motion actuators 103. " "Referring to FIGS. 9A and 
9B, in other embodiments, sensors are placed over various parts of a robot. " 3 "Referring to 
FIGS. 8 A and 8B, in still other embodiments, tactile sensors 104 are placed on the exterior of a 
robot hand 102 located in Location A. Corresponding tactile actuators 106 are sewn into an 
interior of a glove 104 worn by a user in location B. Using system 10, a user in location B can 
feel objects in Location A. For example, a user can see a vase within a room, walk over to the 
vase, and pick-up the vase. The tactile sensors-actuators are sensitive enough so that the user 
can feel the texture of the vase. ,A "Signals within system 10 are sent using a standard streaming 
connection using time-stamped packets or a stream of bits over a continuous connection. " 5 

The inventive features of claim 1 also include a body suit having tactile actuators, the 
actuators receiving the tactile signals from the corresponding tactile sensors on the robot from 
the communications network, wherein the tactile sensors and the corresponding tactile actuators 
are calibrated in connection with variable sensitivity associated with different regions of a 
human. "Referring to FIGS. 7 A and 7B, the user 22a is shown wearing motion sensors 101, 
over portions of their bodies... "Each motion actuator 103 placement corresponds to a motion 
sensor 101 on the user 22a so that each motion sensor activates a motion actuator in the robot 
that makes the corresponding movement. " 1 "Referring to FIGS. 9 A and 9 B ...Corresponding 
actuators can be sewn in the interior of a body suit that is worn by a user. The sensors and their 



1 Specification Page 3, Lines 17-26. 

2 Id, Page 6, Lines 13-18 

3 Id, Page 7, Lines 20-21 

4 Id, Page 7, Lines 11-19 

5 Id, Page 5, Lines 16-18 

6 Id, Page 6, Lines 13-14 

7 Id, Page 6, Lines 18-21 
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corresponding actuators are calibrated so that more sensitive regions of a human are calibrated 
with a higher degree of sensitivity. "* 

The inventive features of claim 1 also include a gateway device that overlays supplement 
tactile sensations with stored virtual tactile sensations that are sent to the body suit. "[GJateway 
16a can also supplement tactile sensations with stored virtual tactile sensations. For example, a 
user can feel the sand on her feet in the beach scene or a cold breeze on her cheeks in a 
mountain top scene. " 9 



Claim 13 is directed to a method of having a virtual encounter. u Referring to FIG. 1, a 
virtual encounter system 10 includes in a first location A, a mannequin 12a, a communication 
gateway 16a, a set of goggles 20a worn by a user 22a, and two wireless earphones (earphone 
24a and earphone 26a) also worn by user 22a. System 10 can further include in a location B, a 
mannequin 12b, a communication gateway 16b, a set of goggles 20b worn by a user 22b, and 
two wireless earphones (earphone 24b and earphone 26b) also worn by user 22b. Gateway 16a 
and gateway 16b are connected by a network 24 (e.g., the Internet)."™ 

The inventive features of claim 13 include sending tactile signals to a communications 
network from tactile sensors coupled to a humanoid robot, the tactile sensors positioned along 
the exterior of the robot. "Referring to FIGS. 7 A and 7B ... the mannequins are replaced by 
robots. For example, a robot 12b includes a series of motion actuators 103. " n "Referring to 
FIGS. 9A and 9B, in other embodiments, sensors are placed over various parts of a robot. " n 
"Referring to FIGS. 8 A and 8B, in still other embodiments, tactile sensors 104 are placed on the 
exterior of a robot hand 102 located in Location A. Corresponding tactile actuators 106 are 
sewn into an interior of a glove 104 worn by a user in location B. Using system 10, a user in 
location B can feel objects in Location A. For example, a user can see a vase within a room, 
walk over to the vase, and pick-up the vase. The tactile sensors-actuators are sensitive enough 



8 Specification Page 7, Lines 20-26 

9 Id, Page 8, Lines 14-17 

10 Id. Page 3, Lines 17-26. 

11 Id, Page 6, Lines 13-18 

12 Id, Page 7, Lines 20-21 
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so that the user can feel the texture of the vase. " 13 "Signals within system 10 are sent using a 
standard streaming connection using time-stamped packets or a stream of bits over a continuous 
connection. " I4 

The inventive features of claim 1 3 also include receiving the tactile signals from the 
communications network at a body suit having corresponding tactile actuators, wherein the 
tactile sensors and the corresponding tactile actuators are calibrated in connection with variable 
sensitivity associated with different regions of a human. "Referring to FIGS. 7 A and 7B, the 
user 22a is shown wearing motion sensors 101, over portions of their bodies... " 15 "Each motion 
actuator 103 placement corresponds to a motion sensor 101 on the user 22a so that each motion 
sensor activates a motion actuator in the robot that makes the corresponding movement. " 16 
"Referring to FIGS. 9 A and 9B ...Corresponding actuators can be sewn in the interior of a body 
suit that is worn by a user. The sensors and their corresponding actuators are calibrated so that 
more sensitive regions of a human are calibrated with a higher degree of sensitivity. " 17 

The inventive features of claim 13 also include generating by a gateway device 
supplemental tactile sensations based on stored virtual tactile sensations that are sent to the body 
suit. "[GJateway 16a can also supplement tactile sensations with stored virtual tactile 
sensations. For example, a user can feel the sand on her feet in the beach scene or a cold breeze 
on her cheeks in a mountain top scene. "' 8 

(vi.) Grounds of Rejection to be Reviewed on Appeal 

1) Claims 1-4, and 13-15 stand rejected under 35 U.S.C. 103(a) as being 
unpatentable over Simmons, US 6,741,91 1, in view of Mcintosh, US 5,103,404, in further view 
of Abovitz, US 200410034302 and in further view of Ombrellaro, US 6,726,638. 

2) Claims 5, 8, 9, 16 and 18 stand rejected under 35 U.S.C. 103(a) as being 
unpatentable over Simmons in view of Mcintosh, Abovitz, and Ombrellaro as applied to claims 4 
and 14 above, and further in view of Simmons US 20030030397 (Simmons '397). 

13 Specification, Page 7, Lines 1 1-19 

14 Id, Page 5, Lines 16-18 

15 Id, Page 6, Lines 13-14 

16 Id, Page 6, Lines 18-21 

17 Id. Page 7, Lines 20-26 

18 Id, Page 8, Lines 14-17 
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3) Claims 10 and 19 stand rejected under 35 U.S.C. 103(a) as being unpatentable 
over Simmons in view of Mcintosh, Abovitz, Ombrellaro and Simmons '397 as applied to claims 
5 and 16 above, and further in view of Algazi, US 7,333,622. 

4) Claims 11,12, 20 and 21 stand rejected under 35 U.S.C. 103(a) as being 
unpatentable over Simmons in view of Mcintosh, Abovitz, and Ombrellaro as applied to claims 1 
and 13 above, and further in view of Yee, US 6,016,385. 

5) Claims 6, 7 and 17 stand rejected under 35 U.S.C. 103(a) as being unpatentable 
over Simmons in view of Mcintosh, Abovitz, Ombrellaro, Simmons '397 and Yee as applied to 
claims 5 and 16 above, and further in view of Abbasi, US 6,786,863. 

(vii.) Argument 

Obviousness 

"It is well established that the burden is on the PTO to establish a prima facie showing of 
obviousness, In re Fritsch, 972 F.2d. 1260, 23 U.S.P.Q.2d 1780 (C.C.P.A., 1972)." 

In KSR Intl. Co. v. Teleflexlnc, 127 S.Ct. 1727 (2007), the Supreme Court reversed a 
decision by the Court of Appeal's for the Federal Circuit decision that reversed a summary 
judgment of obviousness on the ground that the district court had not adequately identified a 
motivation to combine two prior art references. The invention was a combination of a prior art 
repositionable gas pedal, with prior art electronic (rather than mechanical cable) gas pedal 
position sensing. The Court first rejected the "rigid" teaching suggestion motivation (TSM) 
requirement applied by the Federal Circuit, since the Court's obviousness decisions had all 
advocated a "flexible" and "functional" approach that cautioned against "granting a patent based 
on the combination of elements found in the prior art." 

In KSR the Supreme Court even while stating that: "the Court of Appeals drew the wrong 
conclusion from the risk of courts and patent examiners falling prey to hindsight bias," warned 
that: "a factfinder should be aware, of course, of the distortion caused by hindsight bias and must 
be cautious of arguments reliant upon ex post reasoning." 

The Court of Appeals, finally, drew the wrong conclusion from the risk of courts and patent 
examiners falling prey to hindsight bias. A factfinder should be aware, of course, of the distortion 
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caused by hindsight bias and must be cautious of arguments reliant upon ex post reasoning. See 
Graham, 383 U. S., at 36 (warning against a "temptation to read into the prior art the teachings of 
the invention in issue" and instructing courts to '"guard against slipping into the use of hindsight'" 
(quoting Monroe Auto Equipment Co. v. Heckethorn Mfg. & Supply Co. , 332 F. 2d 406, 4 1 2 (C A6 
1964))). Rigid preventative rules that deny factfinders recourse to common sense, however, are 
neither necessary under our case law nor consistent with it. 



With respect to the genesis of the TSM requirement, the Court noted that although "As is 
clear from cases such as Adams, 19 a patent composed of several elements is not proved obvious 
merely by demonstrating that each of its elements was, independently, known in the prior art. 
Although common sense directs one to look with care at a patent application that claims as 
innovation the combination of two known devices according to their established functions, it can 
be important to identify a reason that would have prompted a person of ordinary skill in the 
relevant field to combine the elements in the way the claimed new invention does. This is so 
because inventions in most, if not all, instances rely upon building blocks long since uncovered, 
and claimed discoveries almost of necessity will be combinations of what, in some sense, is 
already known." 

"The mere fact that the prior art could be so modified would not have made the 
modification obvious unless the prior art suggested the desirability of the modification." In re 
Gordon, 221 U.S.P.Q. 1125, 1127 (Fed. Cir. 1984). 



Although the Commissioner suggests that [the structure in the 
primary prior art reference] could readily be modified to form the 
[claimed] structure, "[t]he mere fact that the prior art could be so 
modified would not have made the modification obvious unless the 
prior art suggested the desirability of the modification." In re 
Laskowski, 10 U.S.P.Q. 2d 1397, 1398 (Fed. Cir. 1989). 



"The claimed invention must be considered as a whole, and the question is whether there 
is something in the prior art as a whole to suggest the desirability, and thus the obviousness, of 
making the combination." Lindemann Maschinenfabrik GMBH v. American Hoist & Derrick, 
221 U.S.P.Q. 481, 488 (Fed. Cir. 1984). 



19 United States v. Adams, 383 U. S. 39, 40 (1966) 
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Obviousness cannot be established by combining the teachings 
of the prior art to produce the claimed invention, absent some 
teaching or suggestion supporting the combination. Under Section 
103, teachings of references can be combined only if there is some 
suggestion or incentive to do so. ACS Hospital Systems, Inc. v. 
Montefiore Hospital, 221 U.S.P.Q. 929, 933 (Fed. Cir. 1984) 
(emphasis in original, footnotes omitted). "The critical inquiry is 
whether 'there is something in the prior art as a whole to suggest 
the desirability, and thus the obviousness, of making the 
combination.'" Fromson v. Advance Offset Plate, Inc., 225 
U.S.P.Q. 26, 31 (Fed. Cir. 1985). 

Discussion 

(1) Claims 1-4 and 13-15 are patentable over 
Simmons in view of Mcintosh, in further view of 
Abovitz, and in further view of Ombrellaro. 

Claims 1 , 4 and 1 3 

For the purposes of this appeal only, claims 1 , 4 and 1 3 stand or fall together. Claim 1 is 
representative of this group of claims. 

Claim 1 is directed to a virtual reality encounter system. Appellant contends that 
Simmons, Mcintosh, Abovitz, and Ombrellaro, whether each is taken alone or in combination, 
neither describes nor renders obvious at least the feature of: "a gateway device that overlays 
supplement tactile sensations with stored virtual tactile sensations that are sent to the body suit," 
as recited in claim 1 . 

Simmons neither describes nor suggests at least the feature of "a gateway device that 
overlays supplement tactile sensations with stored virtual tactile sensations that are sent to the 
body suit." Rather, Simmons discloses allowing a human operator to perform accurate and real- 
time control over a robot at a remote site as if the operator were actually there. In this regard, 
Simmons states: 



The current invention allows a human operator to perform delicate or 
indelicate tasks with great dexterity remotely with broad multiple and 
synchronized simultaneous sensory iteration as if the user were actually 
there. This includes the accurate, full-body interactive, real time 
perceptions and control of weigh, distance, inner ear balance, 
motion/inertia, speed, pressure, vibration, impact, resistance to action, 
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sound and a true, position responsive visual interface as if his body were 
actually in the remote location. 20 

Appellant contends that not only does Simmons teach away from this feature of claim 1 , 
Simmons would not be capable of using this feature because Simmons requires the user to 
accurately perceive the visual and sensory conditions of a remote environment where the robot is 
operating, as opposed to providing tactile sensations in accordance with a user-defined virtual 



For example, Simmons elaborates on a scenario in which a surgeon controls a robot at a 
remote site to perform surgery on a patient: 



In one hand the surgeon feels the texture, stiffness, slipperiness, resistance 
to squeezing, the pulse as the heart pumps and the weights of the heart just 
as he feels in the other hand the resistance and vibration of the scalpel as it 
makes an incision and encounters more resistance as it goes deeper. He 
appropriately responds to a sudden resistance with just enough additional 
force to over come the scalpel's resistance but not enough to puncture 
below or overextend the cut. 21 

Appellant contends that any modification to Simmons to include providing tactile 
sensations in accordance with a user-defined virtual reality will inevitably incur a life-threatening 
situation and therefore Simmons cannot render obvious the feature of "a gateway device that 
overlays supplement tactile sensations with stored virtual tactile sensations that are sent to the 
body suit" in combination with the other features of claim 1 . 

Mcintosh does not remedy the foregoing deficiencies of Simmons. Rather than providing 
tactile sensations in accordance with a user-defined virtual reality, as required by claim 1, 
Mcintosh suggests to provide accurate and reliable tactile feedback to a human operator because: 



None of the systems are able to provide sensory input to an operator of a 
remote manipulator which gives in real time, an accurate and reliable, as 
well as variable, degree of tactile feedback to the operator to enhance the 
preciseness of his control is often necessary to avoid overcompensation and 
undue time required to achieve the desired action of the manipulator. 22 



reality. 



20 See Simmons at col. 1, lines 36-44. 

21 Id. at col. 2, lines 31-38. 

22 See Mcintosh at col. 2, lines 31-40. 
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The examiner further contends: 



Abovitz teaches a remote surgical apparatus and method wherein network 
and computer overlay tactile sensations to the haptic device of the surgeon 
to indicate haptic cues to indicate violation of sensitive areas ([0067]). It 
would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine the invention of Simmons in view of Mcintosh with the 
teachings of Abovitz because, as Simmons teaches the additional tactile 
sensations indicate to a user boundaries or negative pressure, Abovitz 
similarly indicates using preset haptic sensations to convey a variety of 
information. 23 

Abovitz, likewise fails to remedy the deficiencies of Simmons and Mcintosh. Abovitz 
neither describes nor renders obvious "a gateway device that overlays supplement tactile 
sensations with stored virtual tactile sensations that are sent to the body suit," as recited in claim 
1 . Rather, Abovitz describes a device that sends haptic cues that describe an aspect of a mapping 
of an haptic object. 24 The haptic cues come from haptic objects when a user moves a haptic 
device around a region based upon characteristics of the region. Abovitz states: 



The haptic cues may be provided to the user based on one or more haptic 
objects, for example the attractive haptic object(s) associated with the 
target region and/or the repulsive haptic object(s) associated with the 
anatomical obstacles. The repulsive haptic object(s) generate forces and/or 
torques that guide haptic device 113 away from poses where the virtual tool 
would intersect the anatomical obstacles. Preferably, the repulsive haptic 
cues are active when the virtual tool penetrates the repulsive haptic objects 
or is in proximity to the repulsive haptic objects. The attractive haptic 
object(s) cause the haptic device to generate forces and/or torques that 
guide haptic device 113 toward poses where the virtual tool has the desired 
relationship with the target region. 25 

Nowhere does Abovitz describe, much less suggest, "a gateway device that overlays 
supplement tactile sensations with stored virtual tactile sensations that are sent to the body suit," 
as recited in claim 1 . While Appellant recognizes that haptic is related to the sense of touch 
Abovitz has no teachings that are relevant to this feature of claim 1 . 

Moreover, Appellant contends that one of ordinary skill in the art would not modify 
Simmons using the tactile signals ("haptic cues") described by Abovitz, as such a modification to 



23 Final Office Action, Mail Date May 15, 2009, Page 4 

24 Abovitz [0031]. 

25 Id. Paragraph [0067] 
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Simmons would, as explained supra, inevitably incur a life-threatening situation in the 
combination of Simmons, Mcintosh and Abovitz. 

Further, assuming arguendo that the tactile signals described by Abovitz are stored and 
may be described as virtual (which Appellant does not concede), such signals are not overlaid 
with any other tactile signal. This later feature is completely missing from any combination of 
these references. 

That is, no combination of Simmons, Abovitz, and Mcintosh renders the overlaying of 
supplement tactile sensations with stored virtual tactile sensations obvious. The purported 
combination of Simmons, Abovitz, and Mcintosh fails to describe the overlaying of tactile 
signals with a stored, virtual tactile signal. 

The examiner further contends: 

Ombrellaro teaches that it was well known in communication networks, in 
particular networks that would support remote connections, that multiple 
computer devices are joined by means of gateways that facilitate data 
transfers and conversion from various networks (column 19, lines 35-50). 26 

Appellant concedes that gateway devices are known. However, the feature of "a gateway 
device that overlays supplement tactile sensations with stored virtual tactile sensations that are 
sent to the body suit" would not be known from the combination of Simmons, Abovitz, and 
Mcintosh with Ombrellaro. Thus, while Ombrellaro indeed teaches a gateway device, 
Ombrellaro fails to remedy the deficiencies of the foregoing references because as with 
Simmons, Abovitz, and Mcintosh, Ombrellaro fails to suggest "a gateway device that overlays 
supplement tactile sensations with stored virtual tactile sensations that are sent to the body suit." 

More particularly, Ombrellaro describes a simulator assembly for simulating the tactile 
response of an item. 27 Nowhere does Ombrellaro describe, much less render obvious, "a 
gateway device that overlays supplement tactile sensations with stored virtual tactile sensations 
that are sent to the body suit," as recited in claim 1. 

Rather, Ombrellaro describes: 



26 Final Office Action, Mail Date May 15, 2009, Page 4 

27 Ombrellaro, Column 2, Lines 66-67 
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[T]he present invention, for the remote acquisition and transmission of 
physically derived medical data, includes three general parts: the hand 
control unit 100 (HCU), the patient examination module 200 (PEM), and 
computer software to control the acquisition, calibration, transfer, and 
translation of the physical data between the physician (through the HCU) 
and the patient (through the PEM). The present invention allows a 
physician to apply hand pressures to the HCU 100 that are transmitted to a 
remotely situated patient and applied to selected portions of the patient's 
body through the PEM 200. The pressure response from the patient's body 
is transmitted back to the physician, thereby simulating direct contact 
between the physician and patient. 28 

That is, Ombrellaro is concerned with various sub-modules that work together to provide 
a user with tactile signals. Ombrellaro is not concerned with the overlaying of tactile signals 
with a stored, virtual tactile signal. Further, the combination of Ombrellaro with Simmons, 
Abovitz, and/or Mcintosh neither describes nor renders obvious "a gateway device that overlays 
supplement tactile sensations with stored virtual tactile sensations that are sent to the body suit," 
as recited in claim 1 . 

In rejecting claim 1 over the combination of Simmons in view of Mcintosh, in further 
view of Abovitz, and in further view of Ombrellaro, the examiner contends: 



It would have been obvious to one of ordinary skill in the art at the time of 
the invention to combine the invention of Simmons in view of Mcintosh 
with the teachings of Abovitz because, as Simmons teaches the additional 
tactile sensations indicate to a user boundaries or negative pressure, 
Abovitz similarly indicates using preset haptic sensations to convey a 
variety of information... It would have been very obvious to one of ordinary 
skill in the communication arts to include a gateway in the communication 
network of the Simmons's system to facilitate and enable the computer 
network connection. 29 

The examiner, however, seems to be using Appellant's invention 
as a template through a hindsight reconstruction of Appellants' 
claims. Essentially, the examiner argues that it would have been 
obvious to provide Ombrellaro's gateway device with the ability to 
overlay supplement tactile sensations with stored virtual tactile 
sensations that are sent to the body suit. However, the examiner 
has neither found that functionality in the cited prior art nor has the 
examiner indicated that functionality to be inherent in the 
references. It is only after consideration of Appellant's claims 



Ombrellaro , Column 7, Lines 33-45 

Final Office Action, Mail Date May 15, 2009, Page 4 
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and/or specification that the examiner can make this connection. 
Appellant contends that this is an exercise in ex post reasoning, the 
type of impermissible hindsight reasoning cautioned against by the 
Court in KSR. 

Claim 13 recites similar features and is allowable as claim 1. 
Claims 2 and 14 

Claim 2 further limits claim 1 and recites: ". . .motion sensors positioned throughout the 
body suit, the motion sensors sending motion signals corresponding to movements of each sensor 
relative to a reference point, the motion signals transmitted to the communications network. . .and 
the humanoid robot, receiving, from the communications network the signals from the motion 
sensors, the signals from the motion sensors causing a movement of the robot that is correlated to 
a movement of the body suit." The body suit recited in claim 2 has "tactile actuators. . .calibrated 
in connection with variable sensitivity associated with different regions of a human." 

The Examiner contends that Simmons describes these features of claim 2. 

Appellant disagrees. Appellant contends that Simmons, rather than describing "motion 
sensors positioned throughout the body suit, the motion sensors sending motion signals 
corresponding to movements of each sensor relative to a reference point, the motion signals 
transmitted to the communications network. . .and the humanoid robot, receiving, ... ," describes 
using actuators to measure motion of a robot. That is, Simmons describes: 



Nowhere does Simmons describe or suggest positioning motion sensors throughout a body suit 
as recited in claim 2, because Simmons never mentions calibrating such actuators in connection 
with variable sensitivity associated with different regions of a human. 
Claim 14 recites similar features as claim 2. 



[T]he "tendons" (the form of actuators used in this sample embodiment as 
seen at FIGS. 1,4, etc.) may measure and send the angle position as a 
measure of fractional turns of their gears (see FIG. 2). 30 



Simmons, Column 14, Lines 34-38 
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Claims 3 and 1 5 

Claim 3 depends from claim 2 and further recites ". . .the robot includes actuators 
corresponding to the motion sensors, the actuators causing the robot to move." 

The Examiner contends that Simmons further describes the features of claim 3. 
Appellant disagrees and points out that rather than teaching actuators corresponding to the 
motion sensors, as recited in claim 2, Simmons teaches using actuators to measure a motion of a 
robot. That however is not what is claimed in Appellant's claim 3. 

Claim 15 recites similar features as claim 3. 



Claims 5, 8 and 16 

Claim 5 depends from claim 4, and claim 8 depends from claim 5. It was shown supra 
that Simmons, Mcintosh, Abovitz, and Ombrellaro, whether each is taken alone or in 
combination, neither describes nor suggests "a gateway device that overlays supplement tactile 
sensations with stored virtual tactile sensations that are sent to the body suit," as recited in claim 
1. 

The examiner introduced Simmons '397 in order to cover the features of a set of goggles 
including a display to render the video signals received from the camera and a transducer to 
transduce the audio signals received from the microphone. 

However, Simmons '397 fails to remedy the deficiencies of Simmons, Mcintosh, 
Abovitz, and Ombrellaro. Simmons '397, as with Simmons, teaches away from claim 1 because 
Simmons 397's teaching requires the user to accurately perceive the visual and sensory 
conditions of a remote environment where the robot is operating, as opposed to providing tactile 
sensations in accordance with a user-defined virtual reality". 

Claim 16 depends from claim 14, and recites similar features as claims 5 and 8. 



(2) Claims 5, 8, 9, 16 and 18 are patentable over 
Simmons in view of Mcintosh, Abovitz, and 
Ombrellaro, and further in view of Simmons 
•397. 



31 See Simmons '397 at Paragraph [0003] 



Applicant 
Serial No. 
Filed 
Page 



Raymond Kurzweil 
10/734,616 
December 12, 2003 
15 of 26 



Attorney's Docket No.: 14202-0004001 



Claims 9 and 18 

Claim 9 depends from claim 5. It was shown supra that Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '397 whether each is taken alone or in combination, neither describes 
nor suggests sending audio signals to the communications network as recited in claim 5. A 
purported combination of Simmons, Mcintosh, Abovitz, Ombrellaro, and Simmons '397 
accordingly neither describes nor suggests this feature of claim 9. 

Claim 18 recites similar features as claim 9. 



Claim 10 depends from claim 5. It was shown supra that Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '397 , whether each is taken alone or in combination, neither 
describes nor suggests sending audio signals to the communications network as recited in claim 
5. 

The examiner introduced Algazi to cover the feature of the body including an ear canal 
and the microphone is positioned within the ear canal. However, Algazi fails to remedy the 
deficiencies of Simmons, Mcintosh, Abovitz, Ombrellaro, and Simmons '397. Algazi teaches an 
approach to capturing and reproducing either live or recorded three-dimensional sound. 32 That, 
however, is not what is recited in Appellant's claim 5. Moreover, Algazi does not describe the 
channels or network over which the tactile signals are being sent. 

Claim 19 recites similar features as claim 10. 



(3) Claims 10 and 19 are patentable over 
Simmons in view of Mcintosh, Abovitz, 
Ombrellaro and Simmons '397 and further in 
view of Algazi,. 



(4) Claims 11, 12, 20 and 21 are patentable over 
Simmons in view of Mcintosh, Abovitz, and 
Ombrellaro, and further in view of Yee. 



Claims 1 1 and 20 



32 Algazi, Abstract 
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Claim 1 1 depends from claim 10. It was shown supra that Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '3 9 7 33 whether each is taken alone or in combination neither describes 
nor suggests sending audio signals to the communications network, as recited in claim 10. 

The examiner introduced Yee to cover the feature of the set of goggles comprising a 
receiver to receive the video signals. However, Yee fails to remedy the deficiencies of Simmons, 
Mcintosh, Abovitz, Ombrellaro, and Simmons '397. Appellant contends that Yee teaches a 
robot system wherein an operator in a control center responds with natural movements to 
stimulus signals from the robot environment by issuing commands that control the robot. 34 That, 
however, is not what is recited in Appellant's claim 1 1 , because Yee does not describe the 
channels or network the tactile signals are being sent. 

Further, the examiner failed to include Algazi in the rejection of claim 1 1 . Recall that the 
examiner used Algazi to cover the feature of claim 10, from which claim 1 1 depends. The 
combination of Simmons, Mcintosh, Abovitz, Ombrellaro, Yee, and Simmons '397, whether or 
not Algazi is considered, neither describe nor suggest the features of claim 1 1 . 

Claim 20 recites similar features as claim 11. 

Claims 12 and 21 

Claim 12 depends from claim 5. It was shown supra that Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '397, whether each is taken alone or in combination, neither describes 
nor suggests sending audio signals to the communications network as recited in claim 10. The 
examiner introduced Yee to cover the feature of the robot comprising a transmitter to wirelessly 
send the audio signals, tactile signals, motion signals and the video signals to the 
communications network. 

However, Yee fails to remedy the deficiencies of Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '397. Yee teaches a robot system wherein an operator in a control 
center responds with natural movements to stimulus signals from the robot environment by 



33 The examiner did not explicitly include Simmons '397 in the rejection, but used Simmons '397 in the argument 
for rejection. 

34 Yee, Abstract 
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issuing commands that control the robot. 35 That, is not what is recited in Appellant's claim 12. 
Yee does not describe a transmitter to wirelessly send the . . . tactile signals ... to the 
communications network. 

Claim 21 recites similar features as claim 12. 



Claims 6 and 17 

Claim 6 depends from claim 5. It was shown supra that Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '397 whether each is taken alone or in combination, neither describes 
nor suggests the features of their respective independent claims. 

The examiner introduced Abbasi to cover the feature of a second humanoid robot in the 
second location, the second robot having a second microphone and a second camera; and a 
second set of goggles to receive the video signals from the first camera and a second earphone to 
receive the audio signals from the first microphone, as recited in claim 6. 

While, Abbasi fails to remedy the deficiencies of Simmons, Mcintosh, Abovitz, 
Ombrellaro, and Simmons '397 and thus claims 6 and 17 are allowable, Appellant contends that 
in Abbasi, the surrogates at different sites are not integrated with microphones and cameras, as 
called for in claims 6 and 7. The examiner states, Abbasi's surrogate adds a capacity to engage 
in all types of physical contact. As illustrated in Figure 5 (reproduced below), Abbasi collects 
video and audio information separately from the surrogate 160. 



(5) Claims 6, 7 and 17 are patentable over 
Simmons in view of Mcintosh, Abovitz, 
Ombrellaro, Simmons '397 and Yee, and further 
in view of Abbasi. 



35 Yee, Abstract 



